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Abstract 


An optimal control problem for the continuity equation is considered. The aim of a 
“controller” is to maximize the total mass within a target set at a given time moment. 

The existence of optimal controls is established. For a particular case of the problem, 
where an initial distribution is absolutely continuous with smooth density and the target 
set has certain regularity properties, a necessary optimality condition is derived. It is 
shown that for the general problem one may construct a perturbed problem that satisfies 
all the assumptions of the necessary optimality condition, and any optimal control for the 
perturbed problem, is nearly optimal for the original one. 
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1 Introduction 

Consider a quantity distributed on M”. Suppose that the distribution evolves along a con¬ 
trolled vector field v = v{t, x, u) according to the law of mass conservation; the control pa¬ 
rameter u can be chosen at every time t from a compact set U C M™. Given a time moment 
T > 0 and a target set A C MA, we aim at finding a control u = u{t) that maximizes the total 
mass within A at the time moment T. More formally the problem can be written as follows 


Maximize 



subject to 



(^’ac) 


where /?o = Pq{x) is the density function of an initial distribution and 

U = {tt(-) is measurable, u{t) € U for all t G [0,T]} 


( 1 ) 


is the set of admissible controls. 

First, let us give several motivating examples. 
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Dynamical system with uncertain initial state. Let xq be an initial state of the fol¬ 
lowing dynamical system 

X = v{t, X, u). ( 2 ) 

Assume that one wants to find a control u = u{t) that brings the state of the system to a 
target set A at a given time T. Now let the precise initial state xq be unknown. Instead, 
assume that a probability distribution of xq on the state space is given. In this case, one 
naturally looks for a control that maximizes the probability of hnding the state of the system 
within the target set at time T. This leads to problem (Pac)- 

Flock control. Let po characterize an initial distribution of sheep in a given area. Assume 
that the herd drifts along a vector field Vs{x). Assume, in addition, that there is a dog located 
at u. In this case, a sheep located at x obtains an additional velocity 

Vdix, u) = ip[\x- u|) (x - u). 

When (f is positive this means that the sheep tries to escape the dog. If the interaction 
between the sheep are not relevant, the motion of the whole herd is described by the equation 

pt + divj, [xs(x) + Urf(x, u)] p^ = 0. 

Typically, the dog wants to steer the herd to a target set A at a given time. In this case an 
optimal strategy of the dog is determined by (Pac)- 


Beam control. 

by the system 


The motion of a charged particle in an electromagnetic field is described 


/^=v, 

= e(E + V X B) -bG(t,x,v). 


(3) 


The particle is characterised by its charge e, rest mass mo, and the relativistic mass m = 
mo/-\/l — |vp/c2. Above, x = (xi,X 2 ,X 3 ) are the particle’s coordinates, v = (xi,X 2 ,X 3 ) 
are the velocities, E and B are the electric and magnetic fields, c is the speed of light, and 
G(t,x, v) represents additional forces due to the interaction between the particle and the 
environment. 

Assume that the electromagnetic field depends on a parameter u, which can be chosen at 
every time moment t, i.e.. 


E = E(t, X, u), B = B(t, X, u). 

Then ([3]) can be rewritten in the form ([2]) with x = (xi,X 2 ,X 3 ,ui,U 2 ,U 3 ). 

Producing a single particle (for example, in a particle accelerator) is extremely difficult. 
Instead, a beam of particles is produced. At the initial time moment every beam is character¬ 
ized by its density function pQ defined on the state space of Q. Usually, one wants to focus 
the beams to ensure that the particles traveling in the accelerator collide. Clearly, one can 
formulate this problem as (Pac) with the target set 

A = {(x, v) : |x| < r, |v| < c} , 

where r is a desired radius of the beam. 
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The connection between dynamical systems with uncertain initial states and continuity 
equations is well-known. In the context of control theory it was mentioned in pulls]. A 
basic mathematical model for flocks controlled by a leader is presented in [IDl ITT] . In contrast 
to these papers we neglect the interactions between flock’s members. Formally, a nonlocal 
term describing the internal dynamics of the flock is omitted. For models of the beam control 
we refer to |I8j . 

Existence results for optimal control problems governed by continuity equations seem to be 
missing in the current literature (at least for nonlinear vector fields v). Necessary optimality 
conditions were derived by D. A. Ovsyannikov in [muZKIHI and by A. I. Propoi with his 
collaborators in [m da i2o]. We remark that all the papers mentioned above consider the 
terminal cost functional 


/ 

Jw 


(p{x)p{T, x) dx 


with smooth (p and/or an integral cost functional. Moreover, the initial density po is always 
assumed to be smooth. Finally, let us mention the paper [TTj of S. S. Mazurenko, where the 
dynamical programming method was developed, and the papers BM of R. Brockett, who 
discussed controllability and some connections with stochastic equations. 

In this paper we first study the existence of optimal controls. Next, assuming that the 
initial density po is smooth and the target set A is sufficiently regular, we derive a necessary 
optimality condition. Finally, we discuss the case of integrable pQ and arbitrary A. More 
precisely, we replace (Pac) by a perturbed problem (Pg) which satisfies all the assumptions of 
our necessary optimality condition. Then we show that every control that is optimal for (Pg) 
is “nearly optimal” for (Pac)- 

We believe that our choice of the cost functional is not relevant in the sense that the 
methods developed here should work in other cases as well. At the same time, in many 
situations it seems natural to maximize the total mass within a target set at a given time 
moment. Moreover, our choice of the cost functional allows to derive a rather simple necessary 
optimality condition (see Section SI). 

As we shall see later, dealing with the continuity equation for measures is more natural 
than dealing with that of for functions. For this reason, the main subject of our study is the 
following optimal control problem 


Maximize p{T){A) 

subject to |t‘. + ‘itv.(u(t,x,u(t))f,)=0, 

Now, (Pac) is just a particular case of (P), where the initial probability measure is absolutely 
continuous with density po. 

The paper is organized as follows. In Section [2] we introduce basic notations, discuss the 
continuity equation and generalized controls. In the next section we study the existence of 
optimal controls. Then, in Section U] we prove a necessary optimality condition for a special 
case of (P), where the initial distribution is absolutely continuous with smooth density and 
the target set has certain regularity properties. In the last section we show that the general 
problem (P) can be replaced by a perturbed problem (P^) such that (P^) satisfies all the 
assumptions of our necessary optimality condition and every optimal control for (P^) is “nearly 
optimal” for (P). For the reader’s convenience, we place in Appendix a brief introduction to 
Young measures. 
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2 Preliminaries 

2.1 Notation 

In what follows, |a:| is the Euclidean norm of x G M” and x-y is the scalar product of x,y € M"". 
By Ar and A° we mean the closed and the open r-neighbourhoods of ^4 C i.e., 

Ar = {x ■. \x — y\ <r for some y G A}, 

A° = {x : \x — y\ <r for some y G A}. 

Let denote the set of all probability measures on M"'. We equip with the 

Prohorov distance: 

= inf |e > 0 : -di(^) < '& 2 iA°) + e, 

+ e for all Borel sets ^|. 

The convergence in the resulting metric space is exactly the narrow convergence of measures 
(see O [6]). 

Given a Borel map /: M"" —>■ and a probability measure f), define the pushforward (or 

image) measure d o f~^ by 

o (A) = f} (^f~^{A)J for all Borel sets A C M"'. 

Recall the change of variables formula 

j = j ‘fofd'd, 

which holds for all bounded Borel functions (p: M" —>■ M. 

Below, A is the n-dimensional Lebesgue measure, a is the (n — l)-dimensional Hausdorff 
measure, pX is a probability measure which is absolutely continuous with respect to A and 
whose density is p. 


2.2 Flows of vector fields 


Consider a vector field v: [0, T] x MA —M"' satisfying the assumption 


(AO) 


The map v = v{t, x) is measurable with respect to t; there are 
< positive constants L, C such that, for all t G [0,T] and x,x' G M", 
\v{t,x) — v{t,x')\ < L\x — x'\ and |u(t,x)| < C (l + |x|) . 


Then there exists a unique solution s i—>■ Vf{x) to the Cauchy problem 


y{s) = V {s,y{s)) , 
y{t) = X. 


The map {s,t,x) !->■ Vf{x) is called the flow of the vector field v. Recall that the function 
X I—)• Vf{x) is a diffeomorphism and 


vfov; = vf, R/ = id, 

Lip (R/) < |R/(x)| < (l + |x|) , 

for any s,t,r G [0,T]. For details see, e.g., [3]. 
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2.3 Continuity equation 


Let be a probability measure on M” and u be a vector field satisfying Assumption (AO). 
Consider the Cauchy problem 

(fit + diVa, (u {t, x) fi) = 0, 

\nito) = 'd. 

Definition 1. We say that a map /i G ([to, ?"]; P(R”)) is a distributional solution to dH 
if for any bounded Lipschitz continuous test function (p: [to,^] ^ we have 



+ V ■ Vxp) d/r(t) dt = 0 


and /r(to) = "&■ 


As is known [2], under Assumption (AO) there exists a unique distributional solution 
to ([3|). Moreover, this solution can be written in the form 


/i(t) = d o for all t £ [to, T], 


(5) 


so that fj,{t) is the pushforward of ?? by . 

If d is absolutely continuous, i.e., d = poX, then ([5]) implies that p{t) is absolutely contin¬ 
uous for each t. More precisely, we have p{t) = p{t, •)A, where 


^ Po°yt°{x 
detDVlix) 


2.4 Generalized controls 

Recall that by (usual) controls we mean the maps belonging to U. We shall see later that in 
some cases it is more convenient to deal with generalized controls. We define such controls 
via Young measures. A brief discussion of Young measures is given in Appendix; for a more 
solid introduction to the subject see, for instance, [22] . 

Definition 2. A generalized control is a Young measure v £ y ([0, whose support is 

contained in [0,T] x U. The set of all generalized controls is denoted by y ([0,T]; U). 

It is evident that a Young measure ly associated with a usual control u £ U belongs to 

y[[d,T\,u). 

Proposition 1. The set of generalized controls y ([0,T]; [/) is compact in the space of Young 
measures y ([0, T]; M™). 

Proof. The set y (jO,T]',U) is relatively narrowly compact by Theorem jH It remains to 
verify that it is closed. To this end, consider a converging sequence {rj) C T ([0,T]; U) with 
the narrow limit v. We only have to show that the support of r is contained in [0, T] x U. 
For each j, we have Uj (]0,T[xf7'^) = 0, where is the complement of U. Since the set 
]0,T[xU^ is open, it follows from basic properties of the narrow convergence that 

0 = hminfi/. (]0,r[x[/=) > u (]0,T[xU^) =z.([0,r] x I/") . 

j—>-oo ^ ^ ^ ' 

□ 
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Definition 3. We say that t i-)- is a trajectory corresponding to a generalized control v 
if t !-)■ ii{t) is a distributional solution to the Cauchy problem 


[it + diVa: iy {t, x) jl) = 0, 

m(o) = 


where 


v{t,x) = / v{t,x,oj) dvt{w) 

Ju 


with (t't)tg[o,r] being the disintegration of v. 


( 6 ) 

(7) 


2.5 Limit lemmas 

Here we gather several useful lemmas about sequences of pushforward measures and their 
limits. 

Lemma 1. Suppose that dj G for j = 0,1, 2, and f: M” —>■ M” is a continuous 

function. If dj —> narrowly, then dj o f~^ do o f~^ narrowly. 

Proof. By the change of variables formula, we have 

j ydidj o f-^) = J (f o f ddj , j = 0,1,2,..., 

for each bounded continuous test function y. It remains to notice that (p o f is also bounded 
and continuous. □ 


Lemma 2. Let fj: M” —M"-, j = 0,1,2,... , be continuous functions, and d € V{W^). If 
fj fo pointwise, then d o f~^ d o ff^ narrowly. 

Proof. For every bounded continuous test function y, we can write 

J ‘fd{dof-^) = j ipofjdd, j = 0,1,2,... 

Clearly, y o fj —>• ip o fo pointwise. Now to complete the proof, we apply the Lebesgue 
dominated convergence theorem to the right-hand side of the latter identity. □ 


Lemma 3. Let vj: [0,T] x R"' —>■ R"", j = 0,1,2,... , be vector fields satisfying (AO) with 
common constants L and C, and let Xj = Xj{f) denote a solution to the Cauchy problem 


y(t) = Vj {t,y{t)) , 
y(0) = a. 


j = 0,1,2,... . 


If Vj{-,x) —>■ vo(-,x) weakly in L^ ([0,T];R"') for all x, then Xj{t) —>■ xo{t) for all t G [0,T]. 


Proof. For a fixed t consider the obvious identity 


Xj(t) - Xo(t) 



Vj(s,Xj(s)) 


■i;j(s,xo(s))] ds 
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Observing that 


+ / [fj(s,xo(s))-z;o(s,xo(s))] ds. 

Jo 


Xj(s)) — r;j(s,xo(s))| <-h|xj(s) — xo(s)| for all s, 
we obtain, by Gronwall’s inequality, the following estimate: 


where 


Xj{t) - xo(t)| < \aj{t)\e^^, 


aj{t)= / [i;j(s,xo(s)) - uo(s,xo(s))] ds. 

Jo 


To complete the proof it remains to show that limj_).oo |Q:j(i)| = 0. For this purpose, take 
a sequence (ri)^Q such that 

0 = To < Ti < • • • < ttv = t and r* — Tj-i = — for all i. 


and consider the identity 


,(t) = X] / K'(«>2 ;o(s)) -Vj{s,xo{Ti-i))] ds 

i=l J-Ti-l 

N r, 

+ X] / ®o(T-i)) - ^o('S, a:o(T-i))] ds 


+ / [^^o('S,xo(ri_i)) - xo(s,xo(s))] ds. 

i=l Jn-i 

By Assumption (AO), we have 

|i;j(s,xo(s)) - Xj(s,xo(ri_i))| < L|xo(s) - xo(ri_i)| 

for all i, j, and s. Moreover, by applying the standard ODE’s technique, we can easily verify 
that 

|xo(s) - xo(ri_i)| < — for all s G [ri_i,ri], 
where M > 0 depends only on t, a, and C. Therefore, 


|aj(^)l < 


2LMt^ 


+ / K(s,a:o('ri-i)) - xo(s,xo(ri_i))] ds 

i=l Jn-i 


Passing to the limit as j —)■ oo and then as A —>■ oo, we get limj^oo \aj{t)\ = 0. 
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Lemma 4. Let -i? E and [0,T] ViML) denote a solution to the Cauchy problem 


jnt + div^ {vj{t, x)p.) =0, • _ n 1 9 

l«(0) = tf. . 

where the vector fields Vj satisfy the assumptions of Lemma\M Ifvji-jx) —>■ z;o(-,x) weakly in 
([0,T];M"') for all x, then 

p,j(t) ^ fio{t) narrowly for all iE[0,T]. 


Proof. Let Vj denote the flow of Vj. In view of Lemma [3l the sequence {Vj)^ converges 
pointwise to (Vb)o- Since Pj{t) = d o the statement follows from Lemma [2j □ 

Lemma 5. Let ip E and d E If the support of d is contained in a 

compact set K C M™, then 

/ ip{x) dd [x) ^ CO ip{K), 

Jk 

where coip{K) is the convex hull of ip{K). 


Proof. Choose a seqnence of probability measures of the form 

k 


dk = with x^^K for all i and k, 


2=1 


and snch that dk ^ d narrowly. This can be done as in [6l Example 8.1.6]. Clearly, 


/ ip{x)ddk{x)^ / (p{x)dd{x). 

Ik Jk 


At the same time, we have 


IK 


ip{x)ddk (x) = '^c\ip{x\) E CO (p{K). 


2=1 


Since co ip{K) is closed, the proof is complete. 


□ 


3 Existence 


In this section we study the existence of optimal controls for (P). Throughout the section, 
we make the following assumption 


(Al) 


The map v: [0,r] x M"" x P —M” is continuous; there are positive 
constants L, C such that, for all t E [0,P], u €U, and x,x' E M”, 
\v{t,x,u) — v{t,x',u)\ < L\x — x'\ and x,n)| < C (l + |x|) . 


First, we prove that (P) has solutions within the space of generalized controls. Then, 
under additional assumptions, we show that every trajectory corresponding to a generalized 
control can be produced by a usual one. 
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Theorem 1. If the target set A is closed, then {P) has a solution within the space 3^ ([0, T]; ?7) 
of generalized controls. 

Proof. Let (uj) be a maximizing sequence of generalized controls. In view of Proposition (TJ 
we may assume, without loss of generality, that {rj) converges to some izq. 

Consider the averaged vector helds Vj dehned by 

Vj{t,x)= v{t,x,u})d{i'j)t{uj), j = 0,l,2,.... 

Ju 

It is easy to see that each Vj satisfies Assumption (AO) with constants L and C as in As¬ 
sumption (Al). Hence, for each j, there exists a unique trajectory pj = Pj{t) corresponding 
to Vj. 

For a given x G M”, we denote by {t,u) i-)- v{t,x,u) a continuous extension of {t,u) ^ 
v{t, x, u) to [0, T] X M”* with the property that 

x,n)| < C (l -|- |x|) for all t G [0,T] and u G M™. 

Such an extension exists by the Tietze theorem. It is clear that 

Vj{t,x)= v{t,x,u})d{vj)tiuj), j = 0,l,2,.... 

By using Proposition 01 we get 

Uj (•, x) —>■ uo(-, x) weakly in ([0,T];R™') 

for every x. Now Lemma 0] asserts that 

Pj{T) —> po{T) narrowly. 


Therefore, 


sup(P) = limsup pj{T){A) < po{T){A), 

j^oo 

so that vq is optimal for (P). This completes the proof. 
Corollary 1. Let v have the form 


□ 


i 

v{t, X, u) = vo{t, a;) ^ ipi{t, u)vi{t, x) 

i=l 


for some real-valued functions ^pi. Let the set 


HfU) 




C 


he convex, and the target set A be closed. Then (P) has a solution within the space U of usual 
controls. 
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Proof. Let i' be an optimal generalized control. The corresponding averaged vector field is 
given by 



v{t,x,u})dut{u}) = vo{t,x) + 'y] / ipi{t,u})dut{uj)vi{t,x). 

i=i JU 


Thus to complete the proof, it suffice to show that there exists a measurable function 
u: [0,T] —)• [/ such that 


'U 


$(t,w)dr't(a;) = 


yf^ipi{t,ui)dut{u:) j \ipi {t,u{t)) ^ 


= ^ {t,u{t)) 


for almost every t G [0,T]. The latter follows from Filippov’s lemma [12], since 



^{t,u)) dvt{io) G ^{t,U) 


according to Lemma [5j 


for a.e. t G [0, T], 


□ 


4 Necessary optimality condition 

4.1 Statement 

Throughout this section, in addition to (Al), we make the assumption 
(A2) The map v = v{t,x,u) is twice continuously differentiable 
with respect to x. 

Theorem 2. Let A be a compact set with the interior ball property 0 and "d = poX with 
Pq G Let u be an optimal control for [P] and p, be the corresponding trajectory. 

Then for almost every r G [0,T], we have 

/ p{t, x) V (r, x, u{t)) ■ (x) da{x) 

JdA^ 

= min / p{t,x)v{t,x,uj) ■ nA'^{x)da{x) . (8) 

Here A'^ = Vf{A) with V being the flow of the vector field {t,x) v [t,x,u{t)), nA^(x) is 
the measure theoretic outer unit normal to A'^ at x, a is the {n — 1)-dimensional Hausdorff 
measure, p{t,-) is the density ofp{t). 

Remark 1. 1. If dA is an (n — l)-dimensional surface, then A automatically has the 
interior ball property. Moreover, each dA'^ is also an (n — l)-dimensional surface. Con¬ 
sequently, in this case nA-^{x) is the usual outer unit normal to A’’ at x, and a is the usual 
{n — l)-dimensional volume form. 

2. The necessary optimality condition has a visual geometrical meaning. Let u = u{t) be 
optimal. Shift the target set A along the vector field (t, x) eA v (t, x, u{t)) backwards. Denote 
the resulting image of A at the time moment r by A’’. Then u{t) minimizes the outflow 
through dA^ at almost every time moment r. 

^i.e., A is the union of closed balls of a certain positive radius r. 
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The proof of Theorem [2] is based on ideas of the Pontryagin Maximum Principle (see, 
e.g., m). In addition, it relies on notions of the interior ball property of a set and the 
directional derivative of a real-valued function on P(]R"'). We discuss these notions below, 
but first let us briefly outline the proof. 


Sketch of the Proof: Let u = u{t) be an optimal control, ft = p,{t) be the corresponding 
trajectory, and V be the flow of {t,x) v {t,x,u{t)). Fix some r E [0, T] and consider the 
map /("i?) = o Vf{A) defined for all absolutely continuous tD with smooth density. First, 
we show that / is directionally differentiable with respect to any vector field w E 
and compute its derivative d^f- Then, we construct a needle variation Ue of u and show that 

^p.^{T){A%=Q = dyjf {fi{T)) for almost all r, 

where /i^ = pie{t) is the trajectory corresponding to = u^it) and u) is a certain vector field 
depending on r. Now, the necessary optimality condition is as follows: 

dwf < 0 for almost all r. 


4.2 Interior ball property 


Recall that a compact set A has the interior ball property of radius r > 0 if it is the union 
of closed balls of radius r. Such sets have nice regularity properties; in particular, dA is 
(n — l)-rectifiable [JI] and 


a{dA) < 


na„(diam^)’^ 

2^r 


(9) 


where is the volume of the n-dimensional unit ball [T]. As a consequence, the measure 
theoretic outer unit normal n^lx) to A at x exists for cr-a.e. x E dA. 


Lemma 6. Let ip: MA M” be a diffeomorphism such that Lip (<y9 < b. Then for any 

A C M**, we have 


(<^(A))^ C ip{Ai,e) and (<^(^))° ^ (^(AgJ. 


Proof. We prove only the first inclusion, for the second one is entirely similar. Fix some 
A C M". Since is a diffeomorphism, it is enough to show that 


- be 


T ^(As) C ip 1(A) 

Indeed, for any x E A^, there exists y ^ A such that |x — y| < e. By the Lipschitz condition: 

\p~^{x) - p~'^{y)\ < b\x -y\< be. 

Hence, for any x E A^, we have p~^{x) E ((^“^(A))^^. □ 
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Proposition 2. Let be an absolutely continuous probability measure with a continuous 
density p. Let A C M”" be a compact set with the interior ball property of radius r. Let 
be diffeomorphisms such that 

Lip(y5i), Lip(¥55-^), Lip ((^2), Lip ((^ 2 ^) 

are bounded from above by a positive constant b. Then, 

|^?0 -'doip 2 {A)\ < J^n+l . _ (^ 2 (x)|, 

^ ^ xGA 

where M = max{/ 9 (x) : x G ^T2{A)}. 

Proof. First, notice that 

o ipi{A) — o (p2{A)\ <'d {lpi{A) /A Lp2{A)) < MX [ipi{A) A ip2{A)) 

and 

A {ipi{A) A ip 2 {A)) = A [(pi{A) \ (p 2 {A)) + A {(p 2 {A) \ (pi{A)) . 

Set I = dn {ipi{A), (p2{A)^, where du is the Hausdorff distance between compact sets, i.e., 

dniA, A') = inf {e > 0 : A<Z A'^ and A' C A^'^ . 


We get 

Lemma [ 6 ] yields 
so that 


T2{A) C [ipi{A)]i and ^i{A) C [Lp2{A)\i. 


A {p> 2 {A) \ ^pi{A)) < A {p>i{Aib) \ p>i{A)) = A {(pi{Aib \ A)) . 
The Lipschitz condition for ipi implies that 

X{MAib\A))<b^X{Aib\A), 
while the Reynolds transport theorem m yields 


rib 


X{Aib\A) = X{Aib)-XiA)= / a{dAt)dt. 


Recalling Q, we get 
Ab 


a{dAt) dt < 


nanidiam. Af 


rib 


dt reQ;„(diam^)^ 


t + r 


< 


2^r 


b-l. 


Combining all the previous inequalities, we obtain the following estimate: 

A(^2(A)\v^i(^)) < nanidmmAr 

The similar estimate holds for A (^ipi{A) \ ip2{A)'). In order to complete the proof, it remains 
to observe that 

dH[Ti{A), ip2 (^)) < sup I(x) - ip2(x) I. 
xeA 

□ 
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4.3 Directional derivative with respect to a vector field 

The basic idea employed here is to determine directions in by vector fields. Hence 

the usual concept of directional derivative will be modified as follows. 


Definition 4. We say that a map /: ^ R is directionally differentiable with respect 

to a vector field w € C^(R"';R"') at a point € 'P(R"') if there exists the limit 


dwfi'd) 


lim 
€ —^0-|- 


/ o W°) - fid) 
£ 


where W is the flow of w. In this case dwfi'd) is called the directional derivative of / with 
respect to re at 

Proposition 3. Let A C R” be a compact set with the interior ball property of radius r. The 
map f: P(R"’) ^ R defined by 


/{'&) = doVfi{A), i?€P(R”), 


( 10 ) 


is directionally differentiable with respect to any vector field w at every point pX G P(R"'), 
with p G C^(R"';R), and its directional derivative is given by 


dwfipX) 



where uaIx) is the measure theoretic outer unit normal to A at x. 


Proof. It follows from the Reynolds transport theorem that 


d 


dvfipX) = -w / p{x)dx 

ae Jwo{vfiA)) 


e=0 


IVf{A) 


div{pw) dx , 


Now, by applying the Gauss-Green theorem, we complete the proof. 


□ 


4.4 Proof of Theorem [2] 

Let u be an optimal control and p, be the corresponding trajectory. Given r G ]0,T] and 
w G [/, we define the perturbed control Ue by the formula 

juj iftG[r-e,T], 

Ue{t) = < _ 

\u{t) otherwise, 

and denote the corresponding trajectory by /i^. 

Let V and V be the flows of the vector fields (t, x) v {t, x, w) and {t, x) i-A v (t, x, u{t)). 
Notice that 

heir) = p{t -£)o = p{t) o Vf:_^ o (11) 

Finally, let W denote the flow of the vector held 

w{x) = u(r, x,uj) — V (r, x, 'u(r)) . (12) 
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Lemma 7. Under the assumptions of Theoreml^ we have 


lim 
£— 


fjhejT)) - / (/i(r) o VLQ) 


= 0 for a.e. r € [0, T], 


where f is defined by m- 

Proof. 1. In view of (1111) . we have to verify that 


, fi{T)oVf_,oVr^{A)-fl{T)oW^iA) ^ ^ 

hm -= 0 for a.e. rG 0,r . 

e^0+ £ 


(13) 


2. It follows from (11211 that the map is Lipschitz continuous. Now, by Proposition [2] 
and by the Lipschitz property of Vf_^, we obtain 


Hr) o v;_, O Vr%A) - Hr) o W^A) 


< Msup 
xGA 


< Me^^ sup 

xGA 


v;_,ov;-^x)-wHx) 
vf-^x) - v;-^ o wHx) 


for some positive M. 

3. For each x G M”', we have 


WHx) — X = — J w (^IPf (ic)^ ds 
= —w {x)£ — J w — w (x) 


ds 


= —w (x) £ — 


£ rl 



0 ^0 


Dw (^aWHx) + (1 — a)x^ da • (w^x) — ds. (14) 


On the other hand, it follows from (Al) that 

lF°(x) — X < J w ^lF°(x)^ dt < /3(x)e 

for all s G [0, e] and x G M”, where 

Hx) = 2C (l + e^^^ (1 + kl)) . 


(15) 


4. Fix some x,y G M”. Let Xe = Xe{t) and x = xit) denote the solutions to the Cauchy 
problems 

(z = v {t,Z,Ue(t)) , 

1 z(r) = X 

correspondingly. In particular, we have 


and 


Z = V (t, z, u(t)) 
z{r) = y, 


Vfix) = Xe{s), Vfiy) = x{s), for all s G [r - £,t]. 


Notice that 


[x(t -£) -y]- [xe{r -£)-x] 
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V {s,Xe{s),u;) - V {s,x{s),u{s)) 

/ ('S,X£('S),w) - f (s,x('S),w) 

f/ ('S,x(s),w) --y (s,x(s),m(s)) 
J T — £ *- 


ds 


> T — £ 

CT /•! 


ds 


T—e Jo 


DxV {s, axe{s) + (1 - a;)x(s), w) da • (xe(s) - x(s)) ds 


ds. 


+ / ('S,x(s),w) - u (s,x(s),w(s)) 

J T—£ *- 

In other words, for every x,y (z M”, we get 

vr%y)-K^-%x) 

= y-x+ / (s,'h,*(x),a;) - (s,I//(x),h(s)) 

J T — £ *- 


ds 


T — £ 

+ [ f DxV {s,aV^^{x) + {1 - a)V^{y),u) da 
J T — € J 0 


y;(x)-y;(y) ds. (16) 


Finally, it follows from (Al) that 


< lx — 


y\+ f 

J s 


V {t,V^{x),uj) -V {t,VXy),u 


dt 


(17) 


y/(x) - F;(y) 

<\x-y\ + 7 (x,y)e 

for all s G [r — e, r] and x, y G M”, where 

7 (x,y) = c (2 + e^^ (2 + 

5. Set y = W^{x). Now we combine (fTO - (fT7)l . and then recall (fT^ together with (Al) 
in order to estimate the derivatives of the vector fields. In this way we find that 


V;~%x) - o lF°(x) 


for every x G A, where 


< f V [s,V^{x),u}) - V [s,V^{x),u{s)) - w{x) 
J r—£ 


ds + Ne^ 


N = L ■ max ^3/3(x) + 7 ^x, VF°(x)^^ . 

As a consequence, we get 

/i(r) o v;_, o v:;:~^{A) - fi{T) o w^{A) 
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< Me 


Notice that the map 


LT 


/ sup 

/ T—SXGA 


V [s,V^{x),U!) - V [s,V^{x),u{s)) - w(x) 


ds 

+ Ne^ 


S 1-^ sup 
x&A 


V (s, v^(x),uj) - V (s, V^^(x),u(s)) - w {x] 


is integrable. Hence, applying the Lebesgue differentiation theorem and then looking at the 
definition of w, we conclude that (fTlTD holds for almost every r € [0, T], This completes the 
proof of Lemma [71 □ 

Now in view of Proposition [3] and Lemma [71 we see that 

/ {l^e{T)) - f (A(t)) ^ He{T){A) - fl{T){A) 

£ —)'0-|- S £—^O-j- S 


/ {w{x) ■ UAix)) p{T,x)da{x) 

JvzOA) 


>Vf{dA) 

for almost every r € [0, T], where p(r, •) is the density of /i(r). Since ft is an optimal trajectory, 
it follows that p.{T){A) > fi^{T){A) for every e. Therefore, 

— / [w{x) ■ nA{x)) p{t, x) da(x) < 0, 

JdA-^ 

where A'^ = Vf{A). By the definition of w, we obtain 

/ p{t,x) u [t,x,u{t)^ ■ nA{x) da{x) < / p{t,x)u{t,x,u) ■ nA{x)da{x) 

JdA-^ JdA-^ 

for all uj € U and almost every r G [0,T]. The latter inequality is clearly equivalent to ([8]). 
The proof of Theorem [2] is complete. 

5 Variational stability 

5.1 Perturbation of the problem 

Our necessary optimality condition has two major drawbacks; the initial measure i? must be 
absolutely continuous with smooth density and the target set A must have the interior ball 
property. In this section we show how to deal with control problems that do not satisfy the 
above assumptions. In what follows, we suppose that H is a compact set and is an arbitrary 
probability measure; assumptions (Al) and (A2) are still valid. 

Let p = r/(x) be the standard mollifier and Pe{x) = e~'^p{x/e) for any positive e. Define 
the convolution of a probability measure and the map % by 

^*Pe{x)=l Pe{x-y)d'd{y). 

JR" 

The function 'd*pe is known to be smooth [3] . By using the Fubini theorem, we easily obtain 
the identity 

/ d * Pe{x) dx = 1, 

JR" 
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so that (i? * ? 7 e)A is a well defined probability measure. 

Let us perturb the initial problem (P) in the following way: 


subject to 


Maximize /^(r) {Are, 
+ diVa; (t,x,u{t)) fJ, 
At(0) = 


= 0 , 


u G ZY, 


{Pe) 


where r = max 




Theorem 3. Let be optimal for {Pe)- Then every accumulation point i> of the family 
{l^e)e>o 'Is optimal for {P) and max(P£) —)■ max(P) as e ^ 0. Moreover, if id is absolutely 
continuous and X{dA) = 0, then 


max(P) = lim//(T, (18) 

£->0 

where 1 1 —?• /i(t, d, Ve) denotes the trajectory corresponding to the initial distribution i) and the 
generalized control Ue- 

Remark 2. 1. Notice that {Pe) satisfies all the assumptions of Theorem [2J Hence, instead 
of dealing directly with (P), we may consider the perturbed problem (P^) and try to find its 
solution with the aid of Theorem [2j Suppose that we are managed to obtain such a solution. 
Let us denote it by Ve- Then Theorem [3] states that Ue approximates (in the narrow topology) 
a certain solution of the initial problem (P). Moreover, if is absolutely continuous and 
A(9H) = 0, then De is nearly optimal for (P) in the sense of equation (|18l) . 

2. In general one must perturb both the initial distribution d and the target set A even if 
A has already the interior ball property. Indeed, consider the following control system in 


X = u, 
x(0) = xo. 


u\ < 1. 


Assume that the target set A is the unit ball centered at 0 and xq = (—2,0). Our aim is to 
bring the state of the system to A at the time moment T = 1. Clearly, this can be done by 
means of the control u = (1,0). Hence u is a solution to the maximization problem: 

Maximize fi{T){A) 

.ubj«tto L<+di'--W = ». |„|<1, (p,) 

|^/i(0) — 6xq, 

and max(P') = I. Perturbing only the initial distribution, we get the following problem: 


Maximize / p{T, x) dx 


subject to 


pt + diVa; {up) = 0, 


Ittl < I. 


p{0,x) = r]e{x - xo), 

It is easy to see that max(Pg) tends to which is strictly less then max(P') 


(no 
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5.2 Preliminary lemmas 

Lemma 8. Let -d E P(M”') and = {•& *■ Ve)^- Then, dp{'&s,'d) < e. 
Proof. By O page 72] it is enough to show that 

MA)<d{A°) + e 


for any Borel set A. But this follows from the computations: 



Pe{x - y) didiy) dx = / peix - y) dd{y) dx 

lAJR^ JaJa° 


lA2 JA 


Pe{x - y) dx d'd{y) 


< / / Peix - y) dx dd{y) 

JA° JRA 


= ^{K)- 


Lemma 9. Let d E {de) C e > 0, r > 0, and A be a closed set. 

(i) If dp{de,d) < re for all e, then lim^-^o ^£(^r'£) = 'd{A). 

{a) If de ^ d narrowly as e ^ 0, then liminf^-^o 

Proof. The inequality dp{ds,d) < re implies that 

d{A) < de{Are) + re and ds{Are) < d{A 2 r£) + re. 

Therefore, 

limsup'(9£(A,.£) < d{A) < liminf 

and (i) is established. 

Since d^ ^ d narrowly as e —>■ 0, there exists a subsequence {d^^ ) with 
e,- < - and dpid^.,d) < - for all j. 

j j 

As a consequence, we have 



Passing to the limit as j —>■ oo yields 

limsup7?£^.(Ar£^.) < d{A), 

which proves (ii). 


□ 


□ 


18 


Lemma 10. Let be probability measures on ML and v he a generalized control. Then, 

dp{'di,d2)<e => dp {ii{T,'di,v),pi{T,d2,v)) <re, 

where t i—?> fi{t, id, v) is the trajectory corresponding to the initial distribution d and the gen¬ 
eralized control V and r = max{l, 

Proof. Let (/? = Vy, where V is the flow of the vector field 

(t, x)!-)- / v{t,x,Ljj) 

Clearly, t/? is a diffeomorphism, Lip < r, and 

IJ.{T,di,u) = di o ip, p{T,d2,n) = d2 0 p. 

The inequality dp{di,d 2 ) < e means that 

^ Mi?)) J + (e + ^), 

' d2{jp{E))<d\(ip{E))l^^L{eLb). 
for any <5 > 0 and any Borel set E. It follows from Lemma [6] that 

Therefore, for any 5 > 0 and any Borel set E, we have 

dl O p{E) <d2op fMe+'S)) + 
d2 o p{E) <diop M°(£+'5)) + 

That is, dp [p{T,di,p), fj,{T,d2,p)) < re as desired. □ 

5.3 Proof of Theorem [3] 

1. Let us show that 

Ve ^ ^ narrowly p,{T,de,v^) ^ pi{T,d,v) narrowly. (19) 

It follows from Lemma[8]that dp{de,d) < e. Now Lemma [TOl yields 

dp de, n),/u(T, d, r)) < re. (20) 

Hence we can write 

dp {p{T, de, Ve),ti{T, d, v)) < dp {p{T, d^, Ve),p{T, d, n^)) 

+ dp (/j(T, d, ns),d('E, d, n)) < re-h dp {p{T, d, z^e), /i(T, d, n)} . 

Passing to the limit as e —>■ 0 and taking into account Lemma 01 we obtain ()19p . 
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2 . Since is optimal for (-Pe), we have 


u) {Are) < '&£, Ve) {Are) for all V. (21) 

On the other hand, Lemma [9Kz), together with (|20ll . implies that 

lim /i(T, -dei v) {Are) = P-{T, i'){A) for all u. 

£->■0 

Hence passing to the limit in (|21l) yields 

fj,{T, 7?, i'){A) < lim inf fj,{T, 'de, Ve) {Are) for ah v, 

£->■0 

so that 

max(P) < lim inf /i(T, {Are) = lim inf (max(P£)) . (22) 

£->■0 £->-0 ' 

3. Assume that a subsequence {i^sj) converges narrowly to some v. Then, by ()19p . we 
have 

iu(r, 'de ^, T^ej) ^ KT,'&,i^) narrowly. 

Now Lemma [9 Km) implies that 

liminf/i(r,z?£,i/£) {Are) < fJ-{T,'&,i^){A). 

£->•0 

Comparing this inequality with (|22p . we conclude that P is optimal for (P). 

4. To complete the first part of the proof, it remains to show that 

lim sup (max(P£)) < max(P), 

€—^0 


or, equivalently, 

limsui> iJ.{T,'&e,j^6) {As) < ATAA){A: (23) 

£—^0 

where u is an accumulation point of {ue)- To this end, take any converging sequence (^fJ-{T, iyej){Arej 
(we may always find one, since every fi{T, -de, i?e){Are) belongs to the compact segment [0,1]). 

Extract from it a subsequence (^A'^Asj(k)Asj(k))iAej(k))^ such that converges nar¬ 

rowly to some i'. Then, by m, we obtain 

Ai(r,'d£.(^),i?£.(j^)) AT A A)- 

Now it follows from Lemma [91 (m) that 


"An^ATAej^^sj) (^Asj^ 


" k}^T{TAsj^k)^A(k)) {Asj^k)) ^ ATA, AiA- ( 24 ) 


Thus, every converging subsequence of {ATAs^A (^r-e)) satisfies (IMIl . This proves ([23]). 

5. Let us prove the second part of the theorem. Again, take any converging sequence 
(^ATAAej){A^ ■ Extract a subsequence (^ATAAsj^AiA'^ such that i^Sj^k) converges 
narrowly to some P as A: —?> oo. In this case, by Lemma jT] we have 

ATAAs^^u)) ^ ATAA)- (25) 
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Since i? is absolutely continuous, we conclude that iJ.{T, i?, z/) is absolutely continuous as well. 
Now the identity A(5A) = 0 imlies that A is a continuty set of /x(T, z?, z^). Thus, it follows 
from ([2^ that 

lim /x(r,z?,z^£ )(^) = lim /r(r,r9,z7£ )(^) =//(T, z?, z7)(A) = max(P). 

j—>-oo k—>-oo ' 

In other words, every converging subsequence of (;u(T, z?, z/^)) has max(P) as its limit. This 
proves (lisp and completes the proof of Theorem [3l 

A Young measures 

Below, A is the Lebesgue measure on , hi C is a Borel set with A(0) < oo, and }3{Q) 
is the cj-algebra of all Borel measurable subsets of hi. 

Definition 5. A Young measure is a positive Borel measure v on such that z^(AxR'^) = 

A(A) for any Borel set A C 0. The space of all Young measures is denoted by 

Definition 6. The narrow topology on is the weakest topology for which the maps 

u 1 -^ /oxR'^ v^di^ are continuous, where tp runs through the set of all bounded Charateodory 
integrands d on O x M'^. 

We always assume that is equipped with the narrow topology. 

Remark 3. 1. In the above definition one may replace Charatheodory integrands by contin¬ 
uous ones. This fact follows easily from the Scorza-Dragoni theorem. As a consequence, the 
narrow convergence of Young measures enjoys all the properties of the narrow convergence of 
probability measures. 

2. In the definition one may also take test functions of the form 

= 1a(x)/(0, 

where A is a Borel subset of and / is a bounded continuous function on M'^. Bearing that 
in mind, one may easily show that the narrow limit of a sequence of Young measures is a 
Young measure. Indeed, taking p = 1 a- 1r<z, we get 

A(A) = lim z^j(A x = v{A x M*^). 

j^oo 

Definition 7. For a measurable function u: Q ^ the associated Young measure is the 
pushforward of A by the map x i-7> (x, zi(x)). 

The set of Young measures associated with functions is dense in the set of all Young 
measures 

Every Young measure v can be described by its disintegration, which is a family {i'x)x^n 
of probability measures on characterized by 

iy{E)= [ n,,{E^)dx, E € x M'^), 

Jo, 

Charatheodory integrand is a B{Q) ® B(R'^)-measurable map which is continuous w.r.t. the second 
variable. 
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where Ex = {^ : (x,^) € E}. One may show that for any z^-integrable V’ 



^{x,C)diyx (0 


dx. 


Consider, for instance, the Young measure i/ associated with a measurable function tt: n — 
Its disintegration is Ux = ^u{x)- 

Remark 4. The notion of disintegration explains why we think of Young measures as general¬ 
ized controls. Indeed, a map u; 11 —)■ is a usual control: at every x the value of the control 
parameter is prescribed and equal to u{x). A Young measure z/ is a generalized control: at 
every x the control parameter is taken randomly according to the probability distribution i^x- 
Therefore Young measures are analogous to mixed strategies in Game Theory, where players 
choose their strategies randomly according to a probability distribution. 

Proposition 4. Let {uj) be a sequenee of Young measures. Let if: 11 M*” be a bounded 

continuous map. If {vj) converges narrowly to a Young measure v, then the sequence of maps 
X !->■ Jjgd V'(x, d(zzj)a,(^) eonverges to the map X ^ J^a'4’ix,f.) di^xif) weakly 


Proof. Take a bounded measurable function ip: Q ^ M™. The map (x,^) i-> p{x) ■'if{x,f) is 
a bounded Caratheodory integrand. Therefore, 


lim / p{x) ■f:{x,i)dvj{x,f) = I p{x) ■ if{x,f) dv {x,i). 


We may equivalently write 


lim / 
Jn 


p{x) ■ / ip{x,f,)d{uj)x{f)dx = / p{x) ■ / ip{x,^)di'x{f)dx. 

jRd Jn JRd 


Changing p on a A-negligible set does not affect both sides of the equality. Therefore, it holds 
for any (/? G □ 


Definition 8. A subset P of is tight if for every e > 0 there exists a compact set 

A' C such that x K^) < e for all v where K'^ is the complement of K. 

Theorem 4 (Prohorov). Every tight subset of is relatively narrowly eompact. 


References 

[1] O. Alvarez, P. Cardaliaguet, and R. Monneau. Existence and uniqueness for dislocation dynamics 
with nonnegative velocity. Interfaces Free Bound., 7(4):415-434, 2005. 

[2] L. Ambrosio and G. Crippa. Existence, uniqueness, stability and differentiability properties of 
the flow associated to weakly differentiable vector fields. In Transport equations and multi-D 
hyperbolic conservation laws, volume 5 of Lect. Notes Unione Mat. Ital., pages 3-57. Springer, 
Berlin, 2008. 

[3] L. Ambrosio, N. Fusco, and D. Pallara. Functions of bounded variation and free discontinuity 
problems. Oxford Mathematical Monographs. The Clarendon Press Oxford University Press, 
New York, 2000. 

[4] D. Betounes. Differential equations: theory and applications. Springer, New York, second edition, 
2010 . 


22 



[5] P. Billingsley. Convergence of prohahility measures. Wiley Series in Probability and Statistics: 
Probability and Statistics. John Wiley & Sons, Inc., New York, second edition, 1999. A Wiley- 
Interscience Publication. 

[6] V. I. Bogachev. Measure theory. Vol. I, II. Springer-Verlag, Berlin, 2007. 

[7] A. Bressan and B. Piccoli. Introduction to the mathematical theory of control, volume 2 of AIMS 
Series on Applied Mathematics. American Institute of Mathematical Sciences (AIMS), Springfield, 
MO, 2007. 

[8] R. Brocket!. Optimal control of the Liouville equation. In Proceedings of the International 
Conference on Complex Geometry and Related Fields, volume 39 of AMS/IP Stud. Adv. Math., 
pages 23-35. Amer. Math. Soc., Providence, RI, 2007. 

[9] R. Brocket!. Notes on the control of the Liouville equation. In Control of Partial Differential 
Equations, Lecture Notes in Mathematics, pages 101-129. Springer Berlin Heidelberg, 2012. 

[10] R. M. Colombo, M. Garavello, M. Lecureux-Mercier, and N. Pogodaev. Conservation laws in the 
modeling of moving crowds. In Hyperbolic Problems: Theory, Numerics, Applications, volume 8 
of AIMS Series on Applied Mathematics, pages 467-474. American Institute of Mathematical 
Sciences, 2014. 

[11] R. M. Colombo and M. Lecureux-Mercier. An analytical framework to describe the interactions 
between individuals and a continuum. J. Nonlinear Sci., 22(1):39-61, 2012. 

[12] A. F. Filippov. On certain questions in the theory of optimal control. J. SIAM Control Ser. A, 
1:76-84, 1962. 

[13] T. Lorenz. Reynold’s transport theorem for differential inclusions. Set-Valued Anal., 14(3):209- 
247, 2006. 

[14] S. S. Mazurenko. The dynamic programming method in systems with states in the form of 
distributions. Vestnik Moskov. Univ. Ser. XV Vychisl. Mat. Kibernet., (3):30-38, 2011. 

[15] M. V. Nikitin and A. 1. Propoi. Sootnoshenija dvojstvennosti i uslovija optimal’nosti dlja nepre- 
ryvnyh potokovyh zadach. Proceedings of the All-Union Institute for System Research, (13):36-46, 
1988. 

[16] D. Ovsyannikov, A. Ovsyannikov, M. Vorogushin, Y. Svistunov, and A. Durkin. Beam dynamics 
optimization: Models, methods and applications. Nuclear Instruments and Methods in Physics 
Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 558(1):11 
- 19, 2006. Proceedings of the 8th International Computational Accelerator Physics Conference 
{ICAP} 2004 8th International Computational Accelerator Physics Conference. 

[17] D. A. Ovsyannikov. Matematicheskie metody upravleniya puchkami. Leningrad. Univ., Leningrad, 
1980. 

[18] D. A. Ovsyannikov. Modelirovanie i optimizatsiya dinamiki puchkov zaryazhennykh chastits. 
Leningrad. Univ., Leningrad, 1990. 

[19] A. 1. Propoi. Problems of the optimal control of mixed states. Avtomat. i Telemekh., (3):87-98, 
1994. 

[20] A. 1. Propoi and A. V. Pukhlikov. Zadachi optimal’nogo upravlenija v sploshnyh sredah. Pro¬ 
ceedings of the All-Union Institute for System Research, (7):60-77, 1990. 

[21] J. Rataj and S. Winter. On volume and surface area of parallel sets. Indiana Univ. Math. J., 
59(5):1661-1685, 2010. 

[22] M. Valadier. A course on Young measures. Rend. Istit. Mat. Univ. Trieste, 26(suppl.):349-394 
(1995), 1994. Workshop on Measure Theory and Real Analysis (Italian) (Grado, 1993). 


23 



